Data storage and file transfer¶

Data management on the DGX¶

The DGX is shared by many users, so storage must be used carefully.

User data lives in home directories on the data storage (7.68 TB shared NVMe).

Useful commands to monitor usage:

du -sh .              # size of current directory
du -sh *              # size of each subdirectory/file
df -h .               # free/used space on current filesystem

Recommendation: regularly clean large temporary files, checkpoints, and old datasets.

Data transfer¶

Command line (scp / rsync)¶

You can transfer files from/to the DGX with SSH tools.

Copy local directory to DGX:

scp -r ./my_dir <username>@hubia-dgx.centralesupelec.fr:~/

Copy directory from DGX to local machine:

scp -r <username>@hubia-dgx.centralesupelec.fr:~/my_dir ./

For large transfers, prefer rsync:

rsync --partial --progress -av ./my_dir <username>@hubia-dgx.centralesupelec.fr:~/

rsync is more robust for long transfers and can resume partial copies.

GUI tools (especially on Windows)¶

• MobaXterm (recommended for beginners on Windows): SSH terminal + built-in file browser.
• WinSCP: dedicated SFTP/SCP GUI.
• FileZilla: cross-platform SFTP GUI.

For Windows install commands and SSH setup, see Connection and file transfer.